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Statistical properties of interbeat intervals cascade are evaluated by considering the joint probability distribution 
P(Ax2, T2\ Aii, ti) for two interbeat increments Asi and Aa;2 of different time scales n and t%. We present 
evidence that the conditional probability distribution P(Aa;2,T2|Aa;i,ri) may obey a Chapman-Kolmogorov 
equation. The corresponding Kramers-Moyal (KM) coefficients are evaluated. It is shown that while the first and 
second KM coefficients, i.e., the drift and diffusion coefficients, take on well-defined and significant values, the 
higher-order coefficients in the KM expansion are very small. As a result, the joint probability distributions of 
the increments in the interbeat intervals obey a Fokker-Planck equation. The method provides a novel technique 
for distinguishing the two classes of subjects in terms of the drift and diffusion coefficients, which behave 
differently for two classes of the subjects, namely, healthy subjects and those with congestive heart failure. 
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I. INTRODUCTION 

Cardiac interbeat intervals normally fluctuate in a complex 
manner. 1-6 Recent studies reveal that under normal condi- 
tions, beat-to-beat fluctuations in the heart rate may display 
extended correlations of the type typically exhibited by dy- 
namical systems far from equilibrium. It has been argued, 2 
for example, that the various stages of sleep may be char- 
acterized by long-range correlations of heart rates separated 
by a large number of beats. The interbeat fluctuations in the 
heart rates belong to a much broader class of many natural, 
as well as man-made, phenomena that are characterized by a 
degree of stochasticity. Turbulent flows, fluctuations in the 
stock market prices, seismic recordings, the internet traffic, 
and pressure fluctuations in packed-bed chemical reactors are 
example of time-dependent stochastic phenomena, while the 
surface roughness of many materials 7 ' 8 are examples of such 
phenomena that are length scale-dependent. 

The focus of the present paper is on the intriguing statis- 
tical properties of interbeat interval sequences, the analysis 
of which has attracted the attention of researchers from differ- 
ent disciplines. 9-15 Analysis of heartbeat fluctuations focused 
initially on short-time oscillations associated with breath- 
ing, blood pressure and neuroautonomic control. 16 ' 17 Stud- 
ies of longer heartbeat records, however, revealed 1//— like 
behavior. 18,19 Recent analysis of very long time series indi- 
cates that under healthy conditions, interbeat intervals may 
exhibit power-law anticorrelations, 20 follow universal scaling 
in their distributions, 21 and are characterized by a broad mul- 
tifractal spectrum. 22 Such scaling features change with the 
disease and advanced age. 23 The possible existence of scale- 
invariant properties in the seemingly noisy heartbeat fluctua- 
tions is may be attributed to highly complex, nonlinear mecha- 
nisms of physiological control, 24 as it is known that circadian 
rhythms are associated with periodic changes in key physio- 



logical processes. 25-33 In Figure 1 samples of interbeats fluc- 
tuations of healthy subjects and those with congestive heart 
failure (CHF) are shown. 
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FIG. 1. Time series of interbeat intervals x(t) versus interval 
number t for a typical person with congestive heart failure (bottom) 
and a healthy subject (top). 

Recently, Friedrich and Peinke were able 34 to derive a 
Fokker-Planck (FP) equation for describing the evolution of 
the probability distribution function of stochastic properties 
of turbulent free jets, in terms of the relevant length scale. 
They pointed out that the conditional probability density of the 
increments of a stochastic field (for example, the increments 
in the velocity field in turbulent flow) satisfies the Chapman- 
Kolmogorov (CK) equation, even though the the velocity field 
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itself contains long-range, nondecaying correlations. As is 
well-known, satisfying the CK equation is a necessary con- 
dition for any fluctuating data to be a Markovian process over 
the relevant length (or time) scales. 35 Hence, one has a way of 
analyzing stochastic phenomena in terms of the correspond- 
ing FP and CK equations. In this paper the method proposed 
by Friedrich and Peinke is used to compute the Kramers- 
Moyal (KM) coefficients for the increments of interbeat in- 
tervals fluctuatations, Ax(r) = x(t + r) — x(t). Here, Ax is 
the interbeat increments which, for all the samples, is defined 
as, Ax = Ax/a T , where a T is the standard deviations of the 
increments in the interbeats data. It is shown that the first 
and second KM coefficients representing, respectively, the 
drift and diffusion coefficients in the FP equation, have well- 
defined values, while the third- and fourth-order KM coeffi- 
cients are small. Therefore, a FP evolution equation 35 is de- 
veloped for the probability density function (PDF) P(Ax, r) 
which, in turn, is used to gain information on changing the 
shape of PDF as a function of the time scale r 36 (see also Ref. 
[37] for another interesting and carefully-analyzed example of 
the application of the CK equation to stochastic phenomena). 

The plan of this paper is as follows. In Section 2 we de- 
scribe the Friedrich-Peinke method in terms of a KM expan- 
sion and the FP equation. We then apply the method in Section 
3 to the analysis of the increments in the interbeat fluctuations. 



H. THE KRAMERS-MOYAL EXPANSION AND 
FOKKER-PLANCK EQUATION 

A complete characterization of the statistical properties of 
the interbeat fluctuation requires evaluation of the joint PDFs, 
Pn(Axi, ti, • • • , Axjv, r^), for an arbitrary N, the number 
of data points. If the phenomenon is a Markov process, an 
important simplification arises in that, the N -point joint PDF 
Pn is generated by the product of the conditional probabili- 
ties P(Axi+\ , Tj+i I Axi, Ti), for i = 1, • • • , N — 1. Thus, as 
the first step of analyzing a stochastic time series, we check 
whether the increments in the data follow a Markov chain. As 
mentioned above, a necessary condition for a stochastic phe- 
nomenon to be a Markov process is that the CK equation, 34 

P(Ax 2 ,t 2 \Ax 1 ,t 1 ) = 

J d(Ax 3 ) P(Ax 2 ,t 2 \Ax 3 ,t 3 ) P(Aar 3 ,7a|AaJi,n) , (1) 

should hold for any value of t 3 , in the interval t 2 < t 3 < 
Ti. 35 Therefore, we check the validity of the CK equation for 
describing the data using many values of the Ax% triplets, by 
comparing the directly-evaluated conditional probability dis- 
tributions P(Ax 2 ,t 2 \Axi,ti) with those calculated accord- 
ing to right-hand side of Eq. (1). In Fig. 2, the directly- 
computed PDF is compared with the one obtained from Eq. 
(1). Allowing for a statistical error of the order of the square 
root of the number of events in each bin, we find that the PDFs 
are statistically identical. 
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FIG. 2. Test of Chapman-Kolmogorov equation for 
Aasi = -0.42, Axi = and Ax\ = 0.42. The solid and open 
symbols represent, respectively, the directly-evaluated PDF and the 
one obtained from Eq. (1). The PDFs are shifted in the horizontal 
directions for clarity. Values of Ax are measured in units of the stan- 
dard deviation of the increments. The time scales n, T2 and T3 are 
10, 30, and 20, respectively. 

It is well-known that the CK equation yields an evolution 
equation for the distribution function P(Ax,t) across the 
scales t. The CK equation, when formulated in differential 
form, yields a master equation, which takes on the form of a 
FP equation: 35 



-P(Ax,r) 



l) D^(Ax,r) + ^D^(Ax,r) 



dAx 



dAx 2 



P(Ax,t) . (2) 



The drift and diffusion coefficients, D^(Ax,t) and 
£>( 2 ) (Ax, r), are estimated directly from the data and the mo- 
ments M^ k ' of the conditional probability distributions: 



dW(Ax,t) = — lim M<*> 
fe! At^o 



(3) 



M(k) = a7 / dAx ' ( Ax ' ~ Ar ) fcp ( Ax '' T + At I Ax > t ) ■ 

(4) 

The coefficients D^ k '(Ax, r) are known as the Kramers- 
Moyal (KM) coefficients. 



A. Application to Analyzing Heartbeat Data 

As an application of the method, we analyzed both day- 
time (12:00 pm to 18:00 pm) and nighttime (12:00 am to 6:00 
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am) heartbeat time series of healthy subjects, and the day- 
time records of patients with CHF. Our data base includes 10 
healthy subjects (7 females and 3 males with ages between 20 
and 50, and an average age of 34.3 years), and 12 subjects with 
CHF, with 3 females and 9 males with ages between 22 and 
71, and an average age of 60.8 years). The resulting drift and 
diffusion coefficients, and D^ 2 \ are displayed in Figures 
3 and 4. It turns out that the drift coefficient £)W is a linear 
function of Ax, whereas the diffusivity is quadratic in 
Ax. Estimates of these coefficients are less accurate for large 
values of Ax and, thus, the uncertainties increase. Using the 
data set for the healthy subjects we find that, 
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FIG. 3. The drift and diffusion coefficients D^(Ax) and 
D^' (Ax), estimated from Eq. (5) for a healthy subject, follow lin- 
ear and quadratic behavior, respectively. 
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0.057 



0.287 



(5) 



whereas for the patients with CHF we obtain, 

{Ax, t) = -0.013Aa; - 0.0018 , 



D^(Aa 



0.005+^) (A, 



0.013 



0.066 



(6) 



D {1 \Ax,> 



-0.03Ax - 0.0046 



We also computed the average of the coefficients £)W and 
D^> for the entire set of the healthy subjects, as well as those 
with CHF. According to the Pawula's theorem, 34 37 the KM 
expansion is truncated after the second term, provided that the 
fourth-order coefficient (Ax,t) vanishes. For the data 
that we analyze the coefficient is about j^D^ for the 
healthy subjects, and about -^D 1 - 2 ^ for those with CHF. 

Equations (5) and (6) state that the drift coefficients for the 
healthy subjects and those with CHF have the same order of 
magnitude, whereas the diffusion coefficients for given r and 
Aa; are different by about one order of magnitude. This points 
to a relatively simple way of distinguishing the two classes of 
the subjects. Moreover, the r-dependence of the diffusion co- 
efficient for the healthy subjects is stronger than that of those 
with CHF (in the sense that the numerical coefficients of the 
t _1 are larger for the healthy subjects). These are shown in 
Figures 3 and 4. 

The strong r— dependence of the diffusion coefficient 
for the healthy subjects indicates that the nature of the PDF of 
their increments Aa; for given t, i.e., P(Ax, t), is intermit- 
tent, and that its shape should change strongly with r. How- 
ever, for the subjects with CHF the PDF is not so sensitive to 
the change of the time scale r, hence indicating that the incre- 
ments' fluctuations for the subjects with CHF is not intermit- 
tent. These results are completely compatible with the recent 
discoveries that the interbeat fluctuations for healthy subjects 
and those with CHF have fractal and multifractal properties, 
respectively. 22 



III. SUMMARY 

We have shown that the probability density of the interbeat 
interval increments satisfies a Fokker-Planck equation, which 
encodes the Markovian nature of the increments' fluctuations. 
We have been able to compute reliably the first two Kramers- 
Moyal coefficients for the stochastic processes Aa; - the drift 
and diffusion coefficients in the FP representation - and, using 
the polynomial ansatz, 34 obtain simple expressions for them 
in terms of Aa; and the time scale r. We have shown that the 
drift and diffusion coefficients of the increments in the inter- 
beat fluctuations of healthy subjects and patients with CHF 
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have different behavior, when analyzed by the method we use 
in this paper. Hence, they help one to distinguish the two 
groups of the subjects. Moreover, one can obtain the form 
of the path probability functional of the increments in the in- 
terbeat intervals in the time scale, which naturally encodes 
the scale dependence of the probability density. This, in turn, 
provides a clear physical picture of the intermittent nature of 
interbeat intervals fluctuations. 
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FIG. 4. The drift and diffusion coefficients (Ax) and 
£> (2) (A:r) are estimated from the Eq. (6) for typical patients with 
congestive heart failure, and follow linear and quadratic behavior, 
respectively. 

Let us emphasize that the previous analysis 1-6 of the data 
that we consider in this paper indicated that there may be long- 
range correlations in the data which might be characterized by 
self-affine fractal distributions, such as the fractional Brown- 



ian motion or other types of stochastic processes that give rise 
to such correlations. In that method one distinguishes healthy 
subjects from those with CHF in terms of the type of the cor- 
relations that might exist in the data. For example, if the data 
follow a fractional Brownian motion, then the corresponding 
Hurst exponent H is used to distinguish the two classes of 
the subjects, as H < 0.5 (> 0.5) indicates negative (positive) 
correlations in the data, while H = 0.5 indicates that the in- 
crements in the data follow Brownian motion. The method 
proposed in the present paper is different from such analy- 
ses in that, the increments in the data are analyzed in terms 
of Markov processes. This is not in contradiction with the 
previous analyses. Our analysis does indicate the existence of 
correlations in the increments, but, as is well-known in the the- 
ory of Markov processes, such correlations, though extended, 
eventually decay. We distinguish the healthy subjects from 
those with CHF in terms of the differences between the drift 
and diffusion coefficients of the Fokker-Plank equation that 
we construct for the incremental data which, in our view, pro- 
vides a clearer and more physical way of understanding the 
differences between the two groups of the subjects than the 
previous method. 
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